Optimal elicitation of probabilistic information from experts
نویسندگان
چکیده
It is often desirable to describe information derived from the cumulative experience of experts in a quantitative and probabilistic form. Pertinent examples include assessing the reliability of alternative models or methods of data analysis, estimating the reliability of data in cases where this can not be measured, and estimating ranges and probable distributions of rock properties and architectures in complex geological settings. This paper presents a method to design an optimised process of elicitation (interrogation of experts for information) in real time, using all available information elicited previously to help in designing future elicitation trials. The method maximises expected information during each trial using experimental design theory. We demonstrate this method in a simple experiment in which the conditional probability distribution or relative likelihood of a suite of 9 possible 3-D models of fluvial-deltaic geologies was elicited from a geographically remote expert. Although a geological example is used, the method is general and can be applied in any situation in which estimates of expected probabilities of occurrence of a set of discrete models are desired.
منابع مشابه
Improving the Distribution of Rural Health Houses Using Elicitation and GIS in Khuzestan Province (the Southwest of Iran)
Background Rural health houses constitute a major provider of some primary health services in the villages of Iran. Given the challenges of providing health services in rural areas, health houses should be established based on the criteria of health network systems (HNSs). The value of these criteria and their precedence over others have not yet been thoroughly investigated. The present study w...
متن کاملA comparison of two methods for expert elicitation in health technology assessments
BACKGROUND When data needed to inform parameters in decision models are lacking, formal elicitation of expert judgement can be used to characterise parameter uncertainty. Although numerous methods for eliciting expert opinion as probability distributions exist, there is little research to suggest whether one method is more useful than any other method. This study had three objectives: (i) to ob...
متن کاملProposal for a Five-Step Method to Elicit Expert Judgment
Elicitation is a commonly used tool to extract viable information from experts. The information that is held by the expert is extracted and a probabilistic representation of this knowledge is constructed. A promising avenue in psychological research is to incorporated experts' prior knowledge in the statistical analysis. Systematic reviews on elicitation literature however suggest that it might...
متن کاملExpert Elicitation of Adversary Preferences Using Ordinal Judgments
Obtaining probabilistic judgments from subject-matter experts is a difficult task, especially when those experts are not quantitatively trained. In this paper, we introduce a simple elicitation process where intelligence experts express their knowledge about adversary preferences by rank ordering the attractiveness of a collection of possible terrorist targets (or attack strategies), where the ...
متن کاملAggregating Probabilistic Forecasts from Incoherent and Abstaining Experts
D makers often rely on expert opinion when making forecasts under uncertainty. In doing so, they confront two methodological challenges: the elicitation problem, which requires them to extract meaningful information from experts; and the aggregation problem, which requires them to combine expert opinion by resolving disagreements. Linear averaging is a justifiably popular method for addressing ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004